WO 2005/048192 PCT/GB2004/004741 

1 

DIGITAL SIGNAL PROCESSING WITH IMPROVED MAPPING 

The invention relates generally to the field of digital signal processing 
and, in a particular example, to a method for obtaining an improved 
5 enhancement of the signal through improved mapping between the signal 
parameters and a set of alternative optimisation parameters in terms of which 
the signal enhancement is performed. 

In general, signal enhancement involves applying one or more 
operations to the signal to improve the signal quality, for example, sharpening 
10 improves signal details, noise reduction removes signal noise. 

While these methods do indeed produce enhanced signals, the quality 
of the resulting signal often varies depending on the signal content. For 
example, a maximum a-posteriori probability algorithm may produce pleasing 
results for a signal that contains structure on only a narrow range of linear 

15 scales. However, using the same algorithm may result in the undesirable 

appearance of oscillatory artefacts when applied to a signal that contains both 
sharp and smooth features. For example, an image of a human face contains 
both sharp features (e.g. wrinkles, and eyelashes) and smooth features (e.g. 
the cheeks and forehead). In the. enhanced image the sharp features may be 

20 surrounded by spurious oscillations that contaminate the smooth features. 

In the enhancement of a digital signal, the digitised data stream may be 
denoted by a vector d containing N d components, where N d is the number of 

data samples. The data vector d may be expressed as some function 0 of 

the true digital signal s that one wishes to enhance, i.e. d =0(s) . The signal 

25 vector s has length N s , where N s is the number of sample points at which the 

signal is estimated. The function 0 can be non-linear and specifies the effect 

of the measuring apparatus on the signal. It is customary to consider the 
function <p in two parts: the predictable effect of the measuring apparatus on 

the signal s; and the stochastic noise part due to inaccuracies in the 
30 measurement process. One may thus write 

d = /?(s)+n, 
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where R denotes the predictable response of the apparatus to the signal and 
n is a vector of length N d containing any stochastic noise contributions to the 

data vector. 

In prior art, there exist signal enhancement algorithms for performing 
5 signal sharpening, noise reduction and other operations (see, for example 
Titterington D. M., 1985, Astronomy & Astrophysics, 144, 381). These 
algorithms provide an estimate § of the underlying signal prior to its 
modification by the measuring apparatus and any addition of noise. The 
vector s is termed the enhanced digital signal. 

10 As a result of correlations between the pixels in the underlying digital 

signal, the effective number of degrees of freedom in the signal enhancement 
problem can be much smaller than the number of parameters in the signal 
vector s. This can lead to spurious artefacts and sub-optimal sharpening and 
noise reduction in the enhanced signal. 

15 a number of approaches have been proposed to accommodate the 

problem of inter-pixel correlations. One approach (Gull S.F., 1989, in Skilling 
J., ed , Maximum Entropy and Bayesian Methods: Developments in Maximum 
Entropy Data Analysis, Dordrecht, pp 53-71) introduced the concept of an 
intrinsic correlation function (ICF) that is used to decorrelate the signal. The 

20 ICF framework has been extended to allow reconstructions of objects on 

different scales (see Weir N., 1992, in ASP Conf. Ser. 25: Astronomical Data 
Analysis Software and Systems I, Vol. 1 , pp 186), proposing a multi-channel 
approach, which allows for multiple scales of pixel-to-pixel correlations. In a 
pyramidal approach (see Bontekoe T.R., Koper E., Kester D.J.M., 1994, 

25 Astronomy & Astrophysics, 284, 1 037) the number of pixels retained in the 
low- resolution channels is decimated. Despite these improvements, choosing 
an ICF is not straightforward and employing suitable scale lengths and 
weights is of great importance. It is clear that there is no single set of ICFs 
that is universally optimal for all possible types of data. 

30 Therefore, there remains a need to accommodate the problem of inter- 

■ 

pixel correlations in a way that is more broadly applicable. 

Accordingly, in a first aspect of the invention, there is provided a 
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method of performing a signal enhancement operation on a digital input signal 
to produce a best estimate of a true signal which the digital input signal is 
assumed to represent, comprising: a) deriving a plurality of candidate 
mappings, each candidate mapping defining a mapping between the signal 
5 domain of the digital input signal and an alternative optimisation domain, each 
signal in the signal domain corresponding to a set of optimisation parameters 
in the optimisation domain; b) for each candidate mapping, calculating an 
indicator of the quality of the candidate mapping and generating a set of 
optimisation parameters in the optimisation domain of the candidate mapping, 
10 the set of optimisation parameters representing an enhanced signal in that 
domain; c) selecting the highest-quality mapping in dependence on the 
calculated indicators; d) selecting the set of optimisation parameters 
generated for the selected mapping in step b); and e) applying the selected 
mapping to the selected set of optimisation parameters to produce an 
1 5 enhanced digital signal in the signal domain. 

In this way, a more efficient and/or effective signal enhancement 
process can be provided, in which the signal enhancement operation and the 
selection of the mapping are preferably performed in a single process or 
search (they are, in essence, performed simultaneously). This can allow the 
20 selection of the mapping to be made dependent on the enhancement of the 
digital signal achievable using the various candidate mappings, for example 
by making the calculation of the quality indicator dependent on the generation 
of the enhanced signal. 

Preferably, the mapping selection step selects the best (or highest- 
25 quality) mapping for representing the enhanced signal (rather than the best 
mapping for representing the digital input signal)! Thus, an enhanced signal 
can be provided which is optimally represented in terms of the selected 
mapping. 

The quality indicator preferably relates to the quality of signal 
30 enhancement which is achievable using a given candidate mapping. 

Preferably, calculation of the quality indicator for a candidate mapping is 
dependent on the enhanced signal generated for that candidate mapping (in 
the form of the generated set of optimisation parameters in the optimisation 
domain of that candidate mapping), and calculating the quality indicator 
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preferably comprises generating the set of optimisation parameters 
representing the enhanced signal. 

The selection of a mapping may also be referred to as basis selection 
(that is, the selection of a basis set for representation of the enhanced signal). 
5 The invention can then be considered to provide a method of performing a 
signal enhancement operation in which the enhancement of the signal and the 
optimal basis selection are performed simultaneously so as to produce an 
enhanced signal that is optimally represented in terms of the chosen basis 
set. The signal enhancement operation may, for example, be image 
10 reconstruction. 

The quality indicator is preferably calculated by evaluating a mapping 
quality function which provides an indication of the quality of a given candidate 
mapping. Evaluating the mapping quality function may comprise performing 
the signal enhancement operation, preferably so as to generate the set of 
15 optimisation parameters representing an enhanced signal. 

Preferably, generating a set of optimisation parameters representing an 
enhanced signal in the optimisation domain of a given candidate mapping 
comprises performing a search through the space of possible sets of 
optimisation parameters in that domain. Performing a search preferably 
20 comprises optimising the set of optimisation parameters with respect to a 
quality measure indicating the quality of an enhanced signal represented by 
any given set of optimisation parameters. In this way, an efficient signal 
enhancement process may be provided. Also, the selection of the mapping 
can be made dependent on the quality of signal enhancement achievable 
25 using the mapping, which can lead to the selection of a better mapping and 
hence to an improvement in the signal enhancement achieved. 

The quality measure preferably comprises a measure of the probability 
that a given set of optimisation parameters represents, in the optimisation 
domain, the true signal. In this way, a more reliable quality measure can be 
30 provided. For efficiency, the search is preferably performed in accordance 
with a numerical optimisation algorithm. 

Advantageously, calculating an indicator of the quality of a candidate 
mapping may comprise analysing a probability distribution of the probabilities 
that given sets of optimisation parameters in the optimisation domain of the 
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candidate mapping represent the true signal. In this way, the selection of the 
mapping can be improved, which can lead to improved signal enhancement 
results. Preferably, generating a set of optimisation parameters representing 
an enhanced signal comprises calculating at least an estimate of the set of 
5 optimisation parameters having the highest probability of representing, in the 
optimisation domain of the candidate mapping, the true signal. The quality of 
image enhancement achieved by the process can thereby be improved- 
Calculating a quality indicator preferably comprises calculating a 
Bayesian evidence function. 
10 In a further aspect of the invention, there is provided a method of 

processing a digital input signal, comprising the steps of: selecting a mapping 
between the signal domain of the digital input signal and an alternative 
optimisation domain in dependence on the digital input signal; deriving an 
alternative signal representation from the digital input signal using the 
15 selected mapping; and performing a signal processing operation on the 

alternative signal representation; and wherein the mapping is selected from a 
plurality of candidate mappings by evaluating a Bayesian evidence function 
which provides an indication of the quality of a given candidate mapping. 

By using a Bayesian evidence function, the mapping selection may be 
20 improved, which may lead to improved signal processing results. The 
Bayesian evidence function preferably at least estimates the Bayesian 
evidence of the digital input signal given a particular candidate mapping. The 
Bayesian evidence can provide a more reliable measure of the quality of a 
given candidate mapping. The Bayesian evidence may be calculated or 
25 estimated depending on efficiency considerations and required accuracy. 

Preferably, each signal in the signal domain corresponds to a set of 
optimisation parameters in the optimisation domain, and the Bayesian 
evidence function estimates or calculates the Bayesian evidence using: a 
likelihood function describing the probability of obtaining the digital input 
30 signal given any particular set of values for the optimisation parameters, given 
the particular candidate mapping; and a prior probability function describing 
the prior probability of the occurrence of any particular set of values for the 
optimisation parameters, given the particular candidate mapping; the prior 
probability function codifying prior knowledge of the distribution of values for 
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the optimisation parameters in advance of analysis of the digital input signal. 
The Bayesian evidence function preferably estimates or calculates the 
Bayesian evidence by estimating or calculating the integral of the product of 
the likelihood function and the prior probability function over all sets of 
5 optimisation parameters in the optimisation domain of the candidate mapping. 

The Bayesian evidence function preferably provides, or forms part of, a 
mapping quality function which provides an indication of the quality of a given 
candidate mapping. 

Preferably, the plurality of candidate mappings are defined by a set of 
10 one or more mapping parameters; and the mapping is selected by optimising 
the mapping quality function, the quality indicator or the Bayesian evidence 
function as a function of the mapping parameters. In this way, the mapping 
may be selected more efficiently. 

The mapping parameters may be discrete and act as labels for a set of 
15 pre-defined mappings. This may provide an efficient mapping selection 
process. Alternatively, the candidate mappings may be defined by a 
continuously parameterisable mapping function. In this way, a wider range of 
mappings can be provided, which can lead to the selection of a more suitable 
mapping and hence to improved image processing or enhancement results. 
20 The mapping is preferably selected in dynamic dependence on the 

signal, or in dynamic dependence on a defined unit of the signal. The digital 
input signal may, for example, be an image or a portion of an image, in which 
case the mapping is preferably selected in dependence on the image or the 
portion. 

25 The candidate mappings may be general non-linear functions, or may 

be linear functions. The optimisation parameters may, for example, be 
coefficients of sinusoidal functions; coefficients of wavelet functions; 
coefficients of Gaussian functions; coefficients of top-hat functions; 
coefficients of signal-to-noise eigenfunctions of the input signal; or coefficients 

30 of continuous parameterisable functions that vary continuously between two 
or more standard forms. 

The signal processing or enhancement operation may, for example, be 
sharpening; noise reduction; tone scale adjustment; intensity balance 
adjustment; colour balance adjustment; colour re-mapping; de-blocking or 



1 



WO 2005/048192 PCT/GB2004/004741 

7 

image magnification employing interpolation. 

The invention also provides a computer program product for performing 
a signal processing operation, comprising a computer usable medium storing 
a computer program which, when executed, causes a processor to perform a 
5 method as described herein; and digital signal processing apparatus adapted 
to perform a method as described herein. 

In a further aspect of the invention, there is provided digital signal 
processing apparatus for processing a digital input signal, comprising: means 
for selecting a mapping between the signal domain of the digital input signal 
1 0 and an alternative optimisation domain in dependence on the digital input 
signal; means for deriving an alternative signal representation from the digital 
input signal using the selected mapping; and means for performing a signal 
processing operation on the alternative signal representation; wherein the 
selecting means is adapted to select the mapping from a plurality of candidate 
15 mappings using a mapping quality function which provides an indication of the 
quality of a given candidate mapping; wherein the plurality of candidate 
mappings are defined by a continuously parameterisable mapping function of 
a set of one or more mapping parameters; and wherein the selecting means is 
adapted to select the mapping by optimising the mapping quality function as a 
20 function of the mapping parameters. In this way, a wider range of mappings 
can be provided, which can lead to the selection of a more suitable mapping 
and hence to improved image processing results. 

In a further aspect of the invention, there is provided digital signal 
processing apparatus for performing a signal enhancement operation on a 
25 digital input signal represented by signal parameters, comprising means for 
processing the digital input signal to determine the optimal mapping between 
the signal parameters and a set of optimisation parameters; and means for 
utilising said optimal mapping in the signal enhancement operation; the 
optimal mapping being selected from a plurality of candidate mappings in 
30 dependence on a measure of the quality of signal enhancement achievable by 
applying the signal enhancement operation to the digital input signal using a 
given candidate mapping. In this way, a more suitable mapping can be 
selected which can lead to improved signal enhancement results. 

The digital signal processing apparatus preferably further comprises 
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means for determining the quality measure by evaluation of a mapping quality 
function of a set of mapping parameters; and means for obtaining an optimum 
mapping by optimisation of the mapping quality function as a function of the 
mapping parameters. The mapping quality function is preferably a Bayesian 
5 evidence function as described above. The digital signal processing apparatus 
preferably comprises means for performing any of the methods described 
herein. 

In certain aspects, the present invention can have the advantage that 
the correlation structure of the signal itself can deterrhine the mapping 

10 between the signal parameters and the optimisation parameters in terms of 
which the signal enhancement is performed. The mapping can provide an 
efficient means for representing the information content of the signal. By 
performing the enhancement of the signal entirely in terms of optimisation 
parameters connected to the signal parameters by the optimal mapping, an 

15 enhanced signal can be obtained in which the sharpening and noise reduction 
(for example) are substantially improved and the presence of spurious 
artefacts is greatly reduced. 

The invention also provides a computer program and a computer 
program product for carrying out any of the methods described herein and/or 
20 for embodying any of the apparatus features described herein, and a 

computer readable medium having stored thereon a program for carrying out 
any of the methods described herein and/or for embodying any of the 
apparatus features described herein. 

The invention also provides a signal embodying a computer program 
25 for carrying out any of the methods described herein and/or for embodying 
any of the apparatus features described herein, a method of transmitting such 
a signal, and a computer product having an operating system which supports 
a computer program for carrying out any of the methods described herein 
and/or for embodying any of the apparatus features described herein. 

30 The invention extends to methods and/or apparatus substantially as 

herein described with reference to the accompanying drawings. 

Any feature in one aspect of the invention may be applied to other 
aspects of the invention, in any appropriate combination. In particular, 
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method aspects may be applied to apparatus aspects, and vice versa. 

Furthermore, features implemented in hardware may generally be 
implemented in software, and vice versa. Any reference to software and 
hardware features herein should be construed accordingly. 

5 Preferred features of the present invention will now be described, 

purely by way of example, with reference to the accompanying drawings, In 
which:- 

Figure 1 is a flowchart illustrating one embodiment of the present 
invention; 

10 Figure 2 is a flowchart illustrating a second embodiment of the present 

invention; and 

Figure 3 is a block diagram showing a computer system for use with a 
software implementation of the present invention. 

In the following description, the present invention will be described as a 
1 5 method implemented as a software program. Those skilled in the art will 
readily recognise that the equivalent of such software may also be 
constructed in hardware. Because signal enhancement algorithms and 
methods are well known, the present description will be directed in particular 
to algorithm and method steps forming part of, or cooperating more directly 
20 with, the method in accordance with the present invention. Other parts of such 
algorithms and methods, and hardware and/or software for producing and 
otherwise processing the signal, not specifically shown or described herein, 
may be selected from such subject matters, components, and elements 
known in the art. Given the description as set forth in the following 
25 specification, all software implementation thereof is conventional and within 
the ordinary skill in such arts. 

Fig. 1 illustrates a preferred embodiment of the present invention for 
processing a signal with a specific signal processing path in order to obtain an 
enhanced output signal. In general, the present invention performs an 
30 enhancement operation to a signal by describing the signal in terms of a set of 
alternative optimisation parameters, determining the optimal mapping 
between the signal parameters and optimisation parameters; and performing 
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the signal enhancement in terms of the optimisation parameters. 

Referring to Fig. 1 , there is shown a block diagram of the present 
invention. An input digital signal d is obtained. Next, a mapping is selected 
between the space of optimisation parameters h and the signal parameters s . 
5 This mapping may be expressed by the equation s = K(h;p) , where K is a 

function determining the mapping, the form of which may depend on a set of 
subsidiary mapping parameters p . Next, the mapping quality function Q is 

evaluated. The value of the mapping quality function, possibly together with its 
higher derivatives as a function of the mapping parameters p , may then be 

1 0 used to guide the selection of new mappings. Next, from those values of the 
mapping parameters p employed, the values of p that yield the largest value 

of the mapping quality function are selected as the optimal mapping 
parameters p . The corresponding mapping s = #(h;p) is then selected as the 
optimal mapping. Employing this optimal mapping, the signal enhancement 
1 5 problem now takes the form 

d = R(K(h;p))+n. 

This equation may be recast in the standard form for a signal enhancement 

problem by defining the optimal response function R as the composite of the 
optimal mapping function K and the original response function R , thus 

20 R(h) s R(K(h;p)) . The signal enhancement problem can therefore be written 

as 

d = #(h)+n, 

which is directly analogous to equation (1), but is cast entirely in terms of the 

optimisation parameters h and the optimal response function R . Next, a 
25 signal enhancement operation is selected and applied to the signal 

enhancement problem defined by equation (2). The output of the signal 

enhancement operation will be a set of enhanced values h for the 
optimisation parameters. Finally, the output enhanced digital signal 3 is 
obtained by applying the optimal mapping function to the optimisation 

30 parameters, thus s = K(h;ji) . 
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Referring to Fig. 1, the mapping operation may be entirely general, so 
that the signal parameters s are some non-linear function of the optimisation 
parameters h . The mapping parameters p may be continuous and describe a 

continously parameterisable mapping K . Alternatively, the mapping 
5 parameters p may be discrete and act as labels for a set of pre-defined 

mappings. 

In a preferred embodiment, the mapping between the signal 
parameters s and the optimisation parameters h is linear. In this case, the 
operation of the mapping K can be expressed in terms of a mapping matrix 
10 K , so that the signal parameters s may be expressed as s = K(p) h , where • 

denotes the operation of matrix multiplication. This expression may be 
interpreted as the signal being a linear combination of the set of digitised 
basis vectors that make up the columns of the matrix K , with the optimisation 
parameters h acting as the coefficients in the linear combination. 

15 Examples of the form of the digitised basis vectors include: sinusoidal 

functions, wavelet functions, Gaussian functions, top-hat functions, and 
signal-to-noise eigenfunctions. In the case in which the mapping parameters 
p are discrete, they may act as labels for sets of pre-defined basis vectors. In 

the case in which the mapping parameters p are continuous, they may act as 

20 controlling parameters for the form of some continously parameterisable 
function that defines the shape of the digitised basis vectors. A specific 
example of a useful continously parameterisable function is that described by 
the equation 

—n 

9 

25 in which the parameters A and x 0 determine respectively the amplitude and 

width of the basis function, and by varying the values of the indices m and n , 
the form of the function varies continuously and includes the specific forms of 
a top-hat, a Gaussian and a Lorentzian. 

Returning to Fig. 1 , once a mapping, and hence the values of the 
30 mapping parameters p , has been chosen one must calculate the value of a 
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mapping quality function Q(p) . This function may, in general, take any form. 

In any particular signal enhancement problem, whatever requirements exist 
on the properties of the final enhanced signal s may be used to determine the 
nature of Q . The form of Q is chosen so that a final enhanced signal which 

more closely satisfies the requirements yields a larger value of Q . As an 

example, the value of Q may be defined so that a large value indicates the 

presence of fewer ringing artefacts in the enhanced signal. 

In a preferred embodiment, the quality mapping function Q(p) will be 
the Bayesian evidence Pr(d | H ) of the input signal given the mapping 
adopted. The Bayesian evidence may be calculated using the equation 



In this equation the likelihood function Pr(d|h,/f) describes the probability of 

obtaining the input data signal given any particular set of values for the 
optimisation parameters. For example, when the input signal is an image, the 
likelihood function encodes a model for the imaging process by encoding both 
the deterministic properties of the imaging instrument, for example its point 
spread function, and the stochastic part of the imaging process, most notably 
the statistical properties of the noise introduced into the image. For example, 
a standard Gaussian likelihood function may be used. 

The prior Pr(h | H) codifies prior knowledge of the distribution of values 

for the optimisation parameters in advance of analysis of the data. In the 
example of image signals, the prior encodes any knowledge or prejudice 
regarding the form of the image, before analysis of the data. For example, 
most images are non-negative and this may be included as a simple prior. In 
practice, an information-theoretic prior is preferably used, most notably the 
maximum-entropy prior (and generalisations thereof). 

More specifically, the hypothesis H denotes the totality of assumptions 
regarding the signal enhancement problem and includes, for example, the 
assumed form of the response function R , and the assumed statistical 
properties of the noise contribution n . Most importantly, the hypothesis H 
also includes the mapping K used to relate the signal parameters s and the 
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optimisation parameters h. Thus the hypothesis H depends upon the 
mapping parameters p, and we may take the mapping quality function to be 

e(p)^Pr(d|//(p)). 

The practical evaluation of the evidence for any given set of mapping 
5 parameters p can be computationally prohibitive for signal enhancement 

problems in which the number of optimisation parameters is large. In such 
cases, two complementary techniques in the prior art can be used to obtain an 
approximate value for the evidence. The first technique is to take samples 
from the distribution Pr(d | h,#)Pr(h | H) such that the number density of 

1 0 samples is proportional to the probability density of the distribution, possibly 
raised to some power. These samples can then be used to obtain an estimate 
of the evidence (see, for example, Gilks et al., 1995, Markov Chain Monte- 
Carlo in Practice, Chapman and Hall, New York). The second technique 

employs a numerical optimiser to locate the maximum h of the distribution 
1 5 Pr(d | h, H ) Pr(h | H ) . The cu rvature matrix of the distribution is then calculated 

at the maximum point, and used to define a multivariate Gaussian 
approximation to the distribution. The corresponding volume of this 
multivariate Gaussian approximation can be calculated using Monte-Carlo 
evaluation of the curvature matrix determinant and yields an estimate of the 
20 evidence (see, for example, Hobson et al., 2002, Monthly Notices of the Royal 
Astronomical Society, 335, 377). 

Returning to Fig. 1 , alternatively or additionally, the signal 
enhancement operation may be noise reduction, de-blocking, scene balance 
adjustment, tone scale adjustment, colour re-mapping, signal interpolation, 
25 signal sharpening or any other operations with which one or more attributes of 
a signal can be enhanced. 

In a preferred embodiment, the signal enhancement will be performed 
using the maximum a posteriori probability algorithm (see, for example 

Titterington, 1985). The optimal values of the optimisation parameters fi are 
30 taken to be those which maximise the joint probability distribution Pr(h,d | H) , 

which is given by the equation 

Pr(h,d | H ) = Pr(d | h, H) Pr(h | H ). 
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The likelihood function Pr(d \h,H ) and prior Pr(h | H) are as described above. 
In the prior art, it is usual to define the log-likelihood function L(h) such that 
Pr(d \h,H) = exp[L(h)] . and the regularising function 5(h) such that 

Pr(h | H) = exp[5(h)] . The enhanced signal h is then that which maximises 
5 with respect to h the objective function 

^(h)==L(h) + S(h). 

The location of the maximum point is determined using a numerical 
optimisation algorithm. 

If the signal enhancement is performed using the maximum a posteriori 
10 probability algorithm, then this solution will already have been obtained in the 
step in which the approximate value of the Bayesian evidence is calculated 
using a multivariate Gaussian approximation, and so the formal signal 
enhancement step can be avoided, thereby speeding up the process. 

A preferred application of the present invention is to the enhancement 
15 of a digital image d. Such an image may have been subjected to some de- 
sharpening by the imaging apparatus, denoted by the response mapping R , 
and also contain additional noise n resulting from inaccuracies in the imaging 
process. The goal of the image enhancement procedure is to obtain an 
enhanced image s that is a better representation of the original scene s being 
20 imaged, by sharpening and de-noising the data image d . 

A specific illustration of how the present invention may be applied to 
this image enhancement problem is shown in Fig. 2. 

Referring to Fig. 2, in this illustration the mapping parameters p are 
chosen to be discrete and act as labels for a set of pre-defined mappings. 
25 Each mapping is chosen to be linear such that s = K(p) h , where the symbol • 

denotes the operation of matrix multiplication. The specific example of such a 
p re .defined set of mappings K , as illustrated in Fig. 2, is a library of two- 
dimensional orthogonal inverse wavelet transforms, each based on a different 
mother wavelet. In each case, the optimisation parameters h are then the 
30 coefficients of the corresponding digitised wavelet basis functions. 

For each wavelet transform from the library, corresponding to a 
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different value for a single discrete mapping parameter p , one then calculates 

the quality mapping function Q(p) m Pr(d | H(p)) based on the Bayesian 

evidence. In the image enhancement application, it is preferable to estimate 

this quantity by employing a numerical optimiser to locate the maximum h of 
5 the distribution Pr(d j h,H) Pr(h | H) , and then calculate the curvature matrix of 

the distribution at this maximum point to define a multivariate Gaussian 
approximation to the distribution. The numerical maximisation of 
Pr(d|h,/OPr(h|//) can be performed using standard optimisation algorithms, 
such as the conjugate-gradient, variable-metric or quasi-Newton techniques, 
10 or some hybrid method. The curvature matrix M at the maximum can be 

approximated by calculating numerical second differences of the distribution. 
The volume of the corresponding multivariate Gaussian then gives an 
approximate value for the evidence, 

Pr(d | H(p)) m (27t) mn |Mf 1/2 Pr(d | h, H) Pr(h | H), 

15 where Nh is the number of optimisation parameters. The determinant 

of the curvature matrix |M| in the above expression can be evaluated using a 

Monte-Carlo technique. 

The wavelet transform K(p) from the library that yields the largest 
value of Pr(d | H{p)) is chosen as the required optimal mapping, 

20 Returning to Fig. 2, in the preferred embodiment, the image 

enhancement will be performed using the maximum a posteriori probability 

algorithm. The optimal values of the optimisation parameters h , 
corresponding to the optimal mapping, are taken to be those which maximise 
the probability distribution Pr(d|h,#)Pr(h|tf). These values will already have 

25 been obtained in the step in which the approximate value of the Bayesian 
evidence is calculated using a multivariate Gaussian, and so the final 

enhanced image is immediately obtained as s = K(/?)h . 

The present invention may be implemented as computer software for 
execution on a general purpose computer system, in the form of dedicated 
30 processing circuitry, or as a combination of hardware and software. An 
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example of a computer system for use with a software implementation of the 
present invention is illustrated in Figure 3. 

The computer system 100 comprises a central processing unit (CPU) 
or processor 1 10 connected to a Random Access Memory (RAM) 1 12 via a 
5 memory bus, and to a system bus 108. The memory 112 may alternatively or 
additionally be connected directly to system bus 108. Also connected to the 
system bus 1 08 are a file storage device 102 (such as a hard disk drive), a 
display 104 and one or more input devices 106 (such as a keyboard and/or 
mouse). 

10 Executable program code embodying the invention may be stored in 

file storage device 1 02 and is loaded into memory 1 1 2 on startup of the 
program, from where it is executed by processor 110. 

Signal data, such as a digital image, is also stored in file storage device 
102. Under control of the program executing on processor 110, the digital 

1 5 image is loaded into memory 112 and processed in accordance with the 
invention, for example by carrying out an image enhancement operation as 
described above. Further data required for the image enhancement operation, 
such as the library of wavelet transforms described above with reference to 
Figure 2, may be stored in file storage device 102 and accessed when 

20 required. 

* 

The enhanced image produced by the operation of the program can be 
stored in file storage device 1 02 and/or displayed to an operator on display 
104, depending on the intended use of the program. 

For example, in an interactive mode, the operation of the program may 
25 be controlled by an operator using input device 106, with the results displayed 
on display 1 04. Alternatively, the program may operate in a batch mode, 
processing image files stored in file storage device 1 02 and writing the 
resulting enhanced image files back to the storage device. 

The subject matter of the present invention relates to digital signal 
30 processing technology, and in a preferred form provides technology that 

digitally processes a digital image to determine the optimal mapping between 
the signal parameters and a set of optimisation parameters and then utilises 
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the results obtained in the further processing of the digital signal. 

In other forms of the invention, there is provided a method for 
processing a digital signal, comprising the steps of: describing the signal 
values as functions of a set of alternative optimisation parameters; selecting a 
mapping between the signal parameters and the optimisation parameters; 
determining the quality of the mapping by evaluation of a mapping quality 
function of a set of mapping parameters; obtaining an optimum mapping by 
maximisation of the mapping quality function as a function of the mapping 
parameters; providing a signal enhancement operation performed entirely in 
terms of the optimisation parameters; and applying signal enhancement to the 
digital signal using the optimal mapping to produce an enhanced signal. 

There is also provided a method of processing a digital signal, 
comprising the steps of selecting a mapping between the signal domain and 
an alternative optimisation domain in dynamic dependence on the signal; 
deriving an alternative signal representation from the digital signal using the 
selected mapping; and performing a signal processing operation on the 
alternative signal representation. 

In this context, the signal domain is the domain of the signal 
parameters or signal values. The alternative signal representation is 
preferably in the form of a set of optimisation parameters as previously 
described. The optimisation domain is then preferably the domain of the 
optimisation parameters, in which the signal processing operation is 
performed. 

The term "in dynamic dependence on n preferably means in 
dependence on an appropriate unit of the signal, with a mapping being 
selected for each such unit. For example, in an image processing application, 
the mapping is preferably selected in dynamic dependence on an image 
represented by the signal. Alternatively, it may be selected in dynamic 
dependence on a block of pixels within an image, for example a block of eight 
by eight or thirty-two by thirty-two pixels. Other block sizes may, of course, be 
used. 

Advantageously, the mapping is selected from a plurality of candidate 
mappings by evaluating and preferably optimising or maximising a mapping 
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quality function which provides an indication of the quality of a given candidate 
mapping. 

The present invention may be implemented for example in a computer 
program product. A computer program product may include one or more 
5 storage media, for example, magnetic storage media such as magnetic disk 
(such as a floppy disk) or magnetic tape; optical storage media such as optical 
disk, optical tape, or machine readable barcode; solid-state electronic storage 
devices such as random access memory (RAM), or read-only memory (ROM); 
or any other physical device or media employed to store a computer program 
1 0 having instructions for controlling one or more computers to practice a method 
according to the present invention. 

It will be understood that the present invention has been described 
above purely by way of example, and modification of detail can be made 
within the scope of the invention. 



